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[Name of Document] SPECIFICATION 

[Title of the Invention] SERVICE PROVIDING SYSTEM, 

MANAGEMENT TERMINAL, MOBILE MEMBER, SERVICE PROVIDING 
PROGRAM AND SERVICE PROVIDING METHOD 

[Claims] 

[Claim 1] A service providing system for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, comprising: 

storage means for associating object information 
related to the shape and location of the virtual object with 
service information specifying a service content and for 
storing them; and 

location-information acquisition means for obtaining 
location information used for identifying the location of 
the mobile member, 

wherein, when it is determined according to the 
location information obtained by the location-information 
acquisition means and the object information stored in the 
storage means that the mobile member is disposed in the 
inside area of the virtual object identified by the shape 
and location of the virtual object, service corresponding to 
the virtual object is provided according to the service 
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information stored in the storage means. 

[Claim 2] A service providing system according to Claim 

1, 

wherein the mobile member and a management terminal for 
managing the virtual object are connected in a 
communication-allowed manner; 

the mobile member has the location-information 
acquisition means, and sends the location information 
obtained by the location-information acquisition means to 
the management terminal; and 

the management terminal has the storage means, and when 
the management terminal receives the location information, 
it determines according to the received location information 
and the object information stored in the storage means 
whether the mobile member is disposed in the inside area of 
the virtual object identified by the shape and location of 
the virtual object. 

[Claim 3] A service providing system according to Claim 

1, 

wherein the mobile member and a management terminal for 
managing the virtual object are connected in a 
communication-allowed manner; 

the management terminal has the storage means, and 
sends the object information stored in the storage means to 
the mobile member; and 



- 2 - 



the mobile member has the location- information 
acquisition means, and when the mobile member receives the 
object information, it determines according to the location 
information obtained by the location-information acquisition 
means and the received object information whether the mobile 
member is disposed in the inside area of the virtual object 
identified by the shape and location of the virtual object. 

[Claim 4] A service providing system according to one of 
Claims 2 and 3, 

wherein, when the result of the determination indicates 
that the mobile member is disposed in the inside area of the 
virtual object identified by the shape and location of the 
virtual object, the management terminal provides service 
corresponding to the virtual object according to the service 
information stored in the storage means. 

[Claim 5] A service providing system according to one of 
Claims 2 and 3 , 

wherein the management terminal sends the service 
information stored in the storage means to the mobile 
member , and 

when the result of the determination indicates that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, the mobile member provides service corresponding to 
the virtual object according to the received service 
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information. 

[Claim 6] A service providing system according to one of 
Claims 2 to 5, 

wherein the management terminal further comprises : 
input means for performing an input related to 
generation, deletion, or update of the object information; 
and 

object-information processing means for generating, 
deleting, or updating the object information according to 
the content of the input performed by the input means . 

[Claim 7] A service providing system according to one of 
Claims 1 to 6, 

wherein the service information is operation 
information specifying the content of an operation of the 
mobile member or another apparatus, and 

when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object, the mobile 
member or the another apparatus is operated according to the 
operation information corresponding to the virtual object, 
stored in the storage means. 

[Claim 8] A service providing system according to one of 
Claims 1 to 7 , 

wherein the service information specifies the content 
of service in which media information related to characters, 
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images, or video is provided for the mobile member, and 

when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object, the media 
information is provided for the mobile member according to 
the service information corresponding to the virtual object, 
stored in the storage means. 

[Claim 9] A service providing system according to one of 
Claims 1 to 8, 

wherein the service information specifies the content 
of service in which notice information related to a notice 
or guidance information related to a guidance is provided 
for the mobile member, and 

when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object, the notice 
information and the guidance information are provided for 
the mobile member according to the service information 
corresponding to the virtual object, stored in the storage 
means . 

[Claim 10] A service providing system according to one of 
Claims 1 to 9 , wherein the mobile member is a portable 
terminal . 

[Claim 11] A service providing system for associating 
service with a virtual object, for disposing the virtual 
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object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, comprising: 

storage means for associating object information 
related to the virtual object with operation information 
specifying the content of an operation of the mobile member 
or another apparatus, and for storing them, 

wherein, when it is determined according to the object 
information stored in the storage means that the positional 
relationship between the mobile member and the virtual 
object satisfies a predetermined condition, the mobile 
member or the another apparatus is operated according to the 
operation information corresponding to the virtual object, 
stored in the storage means. 

[Claim 12] A service providing system for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, comprising: 

storage means for associating object information 
related to the virtual object with service information 
specifying the content of service, and for storing them, 

wherein, when it is determined according to the object 
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information stored in the storage means that the positional 
relationship between the mobile member and the virtual 
object satisfies a predetermined condition, the service 
corresponding to the virtual object is provided according to 
the service information stored in the storage means; and 

further comprising input means for performing an input 
related to generation, deletion, or update of the object 
information; and object-information processing means for 
generating, deleting, or updating the object information 
according to the content of the input performed by the input 
means . 

[Claim 13] A terminal connected to the mobile member used 
in a service providing system according to Claim 2 in a 
communication-allowed manner, comprising a storage means, 

wherein, when the terminal receives the location 
information, it determines according to the received 
location information and the object information stored in 
the storage means whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 

[Claim 14] A mobile member connected to the management 
terminal used in a service providing system according to 
Claim 3 in a communication-allowed manner, comprising a 
location-information acquisition means, 

wherein, when the mobile member receives the object 
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information, it determines according to the location 
information obtained by the location-information acquisition 
means and the received object information whether the mobile 
member is disposed in the inside area of the virtual object 
identified by the shape and location of the virtual object. 

[Claim 15] A service providing program for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, 

the program making a computer which is capable of using 
storage means for associating object information related to 
the shape and location of the virtual object with service 
information specifying a service content and for storing 
them, and location-information acquisition means for 
obtaining location information used for identifying the 
location of the mobile member, execute processing in which, 
when it is determined according to the location information 
obtained by the location-information acquisition means and 
the object information stored in the storage means that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, service corresponding to the virtual object is 
provided according to the service information stored in the 



- 8 - 



storage means . 

[Claim 16] A service providing program for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, 

the program making a computer which is capable of using 
storage means for associating object information related to 
the virtual object with operation information specifying the 
content of an operation of the mobile member or another 
apparatus, and for storing them, execute processing in 
which, when it is determined according to the object 
information stored in the storage means that the positional 
relationship between the mobile member and the virtual 
object satisfies a predetermined condition, the mobile 
member or the another apparatus is operated according to the 
operation information corresponding to the virtual object, 
stored in the storage means . 

[Claim 17] A service providing program for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, 
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the program making a computer which is capable of using 
storage means for associating object information related to 
the virtual object with service information specifying the 
content of service, and for storing them, execute 

processing in which, when it is determined according to 
the object information stored in the storage means that the 
positional relationship between the mobile member and the 
virtual object satisfies a predetermined condition, the 
service corresponding to the virtual object is provided 
according to the service information stored in the storage 
means , and 

processing implemented as input means for performing an 
input related to generation, deletion, or update of the 
object information, and object-information processing means 
for generating, deleting, or updating the object information 
according to the content of the input performed by the input 
means . 

[Claim 18] A service providing method for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, said method 
comprising the steps of: 

associating object information related to the shape and 
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location of the virtual object with service information 
specifying a service content and storing them; 

obtaining location information used for identifying the 
location of the mobile member; and 

when it is determined according to the obtained 
location information and the object information that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, providing service corresponding to the virtual 
object according to the service information. 

[Claim 19] A service providing method for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, said method 
comprising the steps of: 

associating object information related to the virtual 
object with operation information specifying the content of 
an operation of the mobile member or another apparatus, and 
storing them; and 

when it is determined according to the object 
information that the positional relationship between the 
mobile member and the virtual object satisfies a 
predetermined condition, operating the mobile member or the 
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another apparatus according to the operation information 
corresponding to the virtual object. 

[Claim 20] A service providing method for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, said method 
comprising the steps of: 

associating object information related to the virtual 
object with service information specifying the content of 
service, and for storing them; 

when it is determined according to the object 
information that the positional relationship between the 
mobile member and the virtual object satisfies a 
predetermined condition, providing the service corresponding 
to the virtual object according to the service information; 
and 

performing an input related to generation, deletion, or 
update of the object information, and generating, deleting, 
or updating the object information according to the content 
of the input. 

[Detailed Description of the Invention] 
[0001] 

[Technical Field of the Invention] 
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The present invention relates to systems, terminals, 
mobile members, and programs which associates service with a 
virtual object, disposes the virtual object in a virtual 
space associated with an actual space, and provides service 
according to a positional relationship between a mobile 
member, such as a portable telephone, and the virtual 
object, and more particularly, to a service providing 
system, a management terminal, a mobile member, and a 
service providing program which allow the user to easily 
receive service, which allow the user to receive not only 
information providing service but a variety of service, and 
which can flexibly handle a change in condition. 
[0002] 

[Description of the Related Art] 

As systems for providing information according to the 
movement of the user, there have been conventionally known, 
for example, an information providing means (hereinafter 
called a first conventional case) disclosed in Japanese 
Unexamined Patent Publication No. Hei-10-13720 , and a head- 
mount display apparatus (hereinafter called a second 
conventional case) disclosed in Japanese Unexamined Patent 
Publication No. 2000-152125. 

In the first conventional case, detection sections 103 
and 104 detect the location and direction of a camera 101 by 
a global positioning system (GPS) , and the user specifies an 
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object in an image displayed on a display or finder 108. A 
control section 106 obtains the location information of the 
specified object by calculation, according to the specified 
location, and the detected location and direction, takes out 
the attribute data corresponding to the object from a map- 
data storage section 107 by using the obtained location 
information, and displays on the display or finder 108 or 
output after sound synthesis. 
[0003] 

Therefore, the attribute data of the object in the 
displayed image can be easily obtained and shown to the 
user. 

In the second conventional case, an icon image is 
displayed on an image output section 5 at a position 
corresponding to the line of sight detected by a line-of- 
sight detection section 8, by an input from an operation 
input section 6. To an eye of an operator, the icon image 
overlaps an actual field of sight seen from a window 
section. The operator moves the line of sight to a desired 
position in the field of sight, and fixes it by an 
instruction from the operation input section 6. For 
example, when a text actually located in front of the user 
is observed and a certain area is specified in the text, a 
sentence or word in the specified area is read by an image 
processing section 7 from image information input from a CCD 
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camera section 3, translated into a desired language, and 
displayed on the image output section 5. 
[0004] 

Therefore, an object in an actual field of sight can be 
selected and specified by the movement of the line of sight 
of the operator, and image information in the field of sight 
can be processed by using the line of sight as input means. 

[0005] 

[Problems to be Solved by the Invention] 

In the first conventional case, when the user specifies 
an object in an image displayed on the display or finder 
108, the attribute data of the object is provided. 
Therefore, even when an object associated with attribute 
data effective to the user exists close to a location where 
the user is currently located, however, unless the user 
actively moves, the user cannot obtain the effective 
attribute data. 

[0006] 

In addition, since attribute data is provided for the 
user, the user can only obtain a service of receiving 
information. For example, a demand of the user for printing 
the content of the attribute data associated with an object 
on site is difficult to achieve. Of course, it is possible 
that the attribute data is stored in a memory and the 
attribute data is printed later at a printer placed at the 
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home of the user, but it is not very convenient and the 
demand for printing the data on site cannot be satisfied. 
[0007] 

Further, since the user or an administrator cannot 
generate, delete, or update an object or attribute data, it 
is very difficult that the system is applied to a new object 
such as a building or to an object only temporarily located 
at a place, such as an exhibition, or that users transfer 
information to and from each other. When a case in which 
users transfer information to and from each other is taken 
as an example, if a user makes a comment on a picture in an 
art museum in the first conventional case, for example, it 
is impossible for another user to browse the comment as 
attribute data when the another user stands in front of the 
same picture on another day. 

[0008] 

Also in the second conventional case, in the same way 
as in the first conventional case, since translation is 
performed when the user observes a text placed in front of 
the user and specifies an area in the text, unless the user 
actively performs an action, the user cannot receive a 
service of translation, in the same way as in the first 
conventional case. 

In addition, since a translated text is provided for 
the user, the user can obtain only information providing 
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service as in the first conventional case. 
[0009] 

The present invention has been made in consideration of 
the unsolved issues included in the conventional 
technologies. It is an object of the present invention to 
provide a service providing system for dynamically providing 
service for movement, a management terminal, a mobile 
member, and a service providing program which allow the user 
to easily receive service, which allow the user to receive 
not only information providing service but a variety of 
service, and which can flexibly handle a change in 
condition. 
[0010] 

[Means for Solving the Problems] 

To achieve the foregoing object, a service providing 
system according to the present invention is a service 
providing system for associating service with a virtual 
object, for disposing the virtual object in a virtual space 
associated with an actual space, and for providing service 
corresponding to the virtual object according to a 
positional relationship between a movable mobile member and 
the virtual object, including storage means for associating 
object information related to the shape and location of the 
virtual object with service information specifying a service 
content and for storing them; and location-information 
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acquisition means for obtaining location information used 
for identifying the location of the mobile member, wherein, 
when it is determined according to the location information 
obtained by the location-information acquisition means and 
the object information stored in the storage means that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, service corresponding to the virtual object is 
provided according to the service information stored in the 
storage means. 
[0011] 

With such a structure, the location- information 
acquisition means obtains location information, and it is 
determined according to the obtained location information 
and the object information stored in the storage means 
whether the mobile member is disposed in the inside area of 
the virtual object identified by the shape and location of 
the virtual object. As a result, when it is determined that 
the mobile member is disposed in the inside area of the 
virtual object, service corresponding to the virtual object 
is provided according to the service information stored in 
the storage means . 

[0012] 

A virtual object has a logical shape and a location in 
a virtual space associated with an actual space. The shape 
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may be, for example, a sphere having the center at the 
location and a radius of about 1 m, or may be a cube having 
the center at the location and a side length of about 1 m. 
Alternatively, the shape can be any shape, including a shape 
obtained by imitating a natural thing or a living thing. 
The shape is not limited to a three-dimensional shape, and 
may be a plane shape. Therefore, since an area where 
service is provided is relatively clarified, different 
services can be provided in fine units, such as in units of 
several meters. In addition, since an area where service is 
provided is not a point but has a predetermined range, the 
user is more likely to receive the service. The same points 
are applied to a service providing program and a service 
providing method specified in the present invention. 
[0013] 

Further, the mobile member may be a mobile member in 
the actual space, or may be that in a virtual space. In the 
former case, a portable telephone or a vehicle corresponds 
to the above mobile member. When the present invention is 
applied to a portable telephone or a vehicle, for example, 
service can be provided according to the location of the 
user. In the latter case, a mobile member on a computer 
simulation or a mobile member in a game corresponds to the 
above mobile member. When the present invention is applied 
to a computer simulation, service can be provided according 
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to the location of a mobile member in a virtual space. The 
same points are applied to service providing systems, to a 
mobile member, and service providing programs, and service 
providing methods specified in the present invention. 
[0014] 

Further, provided service includes any service, and is 
not limited to information providing service. It may be, 
for example, service implemented by operating a mobile 
member or another apparatus, and may be service for giving 
the users a predetermined benefit, such as discount. The 
same points are applied to a service providing system, 
service providing programs, and service providing methods 
specified in the present invention. 

Further, the storage means stores object information 
with the use of any means at any time. The storage means 
may store object information in advance. Alternatively, the 
storage means may store object information by an external 
input while the apparatus is operating, without storing the 
object information in advance. This is also applied to 
storage of service information. The same points are applied 
to the service providing systems, to a management terminal, 
to service providing programs, and to service providing 
methods specified in the present invention. 

[0015] 

Further, the present system may be implemented as a 
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single apparatus, or may be implemented as a network system 
in which a plurality of terminals is connected in a 
communication-allowed manner. In the latter case, each 
component needs to be connected in a communication-allowed 
manner. Each component may be connected to any of the 
plurality of terminals. The same points are applied to the 
service providing systems specified in the present 
invention. 

Further, for example, the location- information 
acquisition means may obtain location information by 
measuring the location of the mobile member by the use of a 
communication terminal to which the mobile member is 
connected in a communication-allowed manner. The location- 
information acquisition means may obtain location 
information by measuring the location of the mobile member 
in the mobile member with the use of a GPS, or by a 
calculation performed by the communication terminal 
according to measurement information sent from the mobile 
member. The location-information acquisition means may 
obtain location information by measuring the location of the 
mobile member in a base station connected to the mobile 
member, or by a calculation performed by the communication 
terminal according to measurement information sent from the 
base station. As an example system in which the mobile 
member and the above- described communication terminal are 
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used in combination, a system using a radio- frequency 
identification (RFID) can be used. More specifically, a 
non-contact-type tag from which the tag ID can be read in a 
non-contact manner is attached to the mobile member, and 
tag-ID reading means for reading the tag ID of a non- 
contact-type tag from the tag in a non-contact manner is 
provided for the communication terminal . When the 
communication terminal detects the mobile member by the use 
of the tag-ID reading means, the location-information 
acquisition means obtains the position of the communication 
terminal as the location information of the mobile member. 
In this case, the communication terminal itself can serve as 
tag-ID reading means. The same points are applied to the 
service providing systems, to the mobile member, to the 
service providing programs, and to the service providing 
method specified in the present invention. 
[0016] 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the mobile member and a management terminal 
for managing the virtual object are connected in a 
communication-allowed manner; the mobile member has the 
location-information acquisition means, and sends the 
location information obtained by the location-information 
acquisition means to the management terminal; and the 
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management terminal has the storage means, and when the 
management terminal receives the location information, it 
determines according to the received location information 
and the object information stored in the storage means 
whether the mobile member is disposed in the inside area of 
the virtual object identified by the shape and location of 
the virtual object. 
[0017] 

With such a structure, the mobile member obtains 
location information from the location-information 
acquisition means, and sends the obtained location 
information to the management terminal . 

When the management terminal receives the location 
information, it determines according to the received 
location information and the object information stored in 
the storage means whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 

[0018] 

Service can be provided at any place. An entity which 
provides service is not limited to the management terminal. 
The mobile member or another apparatus may provide service. 
When the management terminal provides service, for example, 
if it is determined that the mobile member is disposed in 
the inside area of a virtual object, the management terminal 
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needs to provide service corresponding to the virtual object 
according to the service information stored in the storage 
means. When the mobile member provides service, for 
example, the management terminal sends a result of 
determination and service information corresponding to the 
virtual object, stored in the storage means to the mobile 
member, the mobile member receives the result of 
determination and the service information, and if the 
received result of determination indicates that the mobile 
member is disposed in the inside area of the virtual object, 
the mobile member needs to provide service corresponding to 
the virtual object according to the received service 
information. 
[0019] 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the mobile member and a management terminal 
for managing the virtual object are connected in a 
communication-allowed manner; the management terminal has 
the storage means, and sends the object information stored 
in the storage means to the mobile member; and the mobile 
member has the location-information acquisition means, and 
when the mobile member receives the object information, it 
determines according to the location information obtained by 
the location- information acquisition means and the received 
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object information whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 
[0020] 

With such a structure, the management terminal sends 
object information stored in the storage means to the mobile 
member . 

The mobile member obtains location information by the 
use of the location-information acquisition means. When the 
mobile member receives object information, it determines 
according to the obtained location information and the 
received object information whether the mobile member is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object. 

[0021] 

Service can be provided at any place. An entity which 
provides service is not limited to the mobile member. The 
management terminal or another apparatus may provide 
service. When the mobile member provides service, for 
example, the management terminal sends object information 
stored in the storage means and the service information 
corresponding thereto to the mobile member, the mobile 
member receives the object information and the service 
information, and if a result of determination indicates that 
the mobile member is disposed in the inside area of the 
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virtual object, the mobile member needs to provide service 
corresponding to the virtual object according to the 
received service information. When the management terminal 
provides service, for example, the mobile member sends a 
result of determination to the management terminal, the 
management terminal receives the result of determination, if 
the received result of determination indicates that the 
mobile member is disposed in the inside area of a virtual 
object, the management terminal needs to provide service 
corresponding to the virtual object according to the service 
information stored in the storage means. 
[0022] 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein, when the result of the determination 
indicates that the mobile member is disposed in the inside 
area of the virtual object identified by the shape and 
location of the virtual object, the management terminal 
provides service corresponding to the virtual object 
according to the service information stored in the storage 
means . 

[0023] 

With such a structure, when the result of the 
determination indicates that the mobile member is disposed 
in the inside area of the virtual object identified by the 
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shape and location of the virtual object, the management 
terminal provides service corresponding to the virtual 
object according to the service information stored in the 
storage means . 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the management terminal sends the service 
information stored in the storage means to the mobile 
member, and when the result of the determination indicates 
that the mobile member is disposed in the inside area of the 
virtual object identified by the shape and location of the 
virtual object, the mobile member provides service 
corresponding to the virtual object according to the 
received service information. 
[0024] 

With such a structure, the management terminal sends 
service information stored in the storage means to the 
mobile member. 

When the result of the determination indicates that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, the mobile member provides service corresponding to 
the virtual object according to the received service 
information . 
[0025] 
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Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the management terminal further includes 
input means for performing an input related to generation, 
deletion, or update of the object information, and object- 
information processing means for generating, deleting, or 
updating the object information according to the content of 
the input performed by the input means . 

With such a structure, when the input means performs an 
input related to generation, deletion, or update of object 
information, the management terminal generates, deletes, or 
updates the object information according to an input content 
by the use of the object- information processing means. 

[0026] 

The input means may allow a direct input to the 
management terminal. It may allow an input through 
communication with the mobile member or another apparatus. 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the service information is operation 
information specifying the content of an operation of the 
mobile member or another apparatus, and when it is 
determined that the mobile member is disposed in the inside 
area of the virtual object identified by the shape and 
location of the virtual object, the mobile member or the 
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another apparatus is operated according to the operation 
information corresponding to the virtual object, stored in 
the storage means . 
[0027] 

With such a structure, when it is determined that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, the mobile member or the another apparatus is 
operated according to operation information corresponding to 
the virtual object, stored in the storage means. 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the service information specifies the 
content of service in which media information related to 
characters, images, or video is provided for the mobile 
member, and when it is determined that the mobile member is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object, the media 
information is provided for the mobile member according to 
the service information corresponding to the virtual object, 
stored in the storage means. 
[0028] 

With such a structure, when it is determined that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
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object, media information is provided for the mobile member 
according to service information corresponding to the 
virtual object, stored in the storage means. 

Further, a service providing system according to the 
present invention is the above-described service providing 
system, wherein the service information specifies the 
content of service in which notice information related to a 
notice or guidance information related to a guidance is 
provided for the mobile member, and when it is determined 
that the mobile member is disposed in the inside area of the 
virtual object identified by the shape and location of the 
virtual object, the notice information and the guidance 
information are provided for the mobile member according to 
the service information corresponding to the virtual object, 
stored in the storage means. 
[0029] 

With such a structure, when it is determined that the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object, notice information and guidance information are 
provided for the mobile member according to service 
information corresponding to the virtual object, stored in 
the storage means . 

Further, a service providing system is the above- 
described service providing system, wherein the mobile 
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member is a portable terminal . 
[0030] 

With such a structure, the portable terminal obtains 
location information by the use of the location-information 
acquisition means . The portable terminal or the management 
terminal determines according to the obtained location 
information and the object information stored in the storage 
means whether the mobile member is disposed in the inside 
area of the virtual object identified by the shape and 
location of the virtual object. 

Further, a service providing system according to Claim 
11 of the present invention is a service providing system 
for associating service with a virtual object, for disposing 
the virtual object in a virtual space associated with an 
actual space, and for providing service corresponding to the 
virtual object according to a positional relationship 
between a movable mobile member and the virtual object, 
including storage means for associating object information 
related to the virtual object with operation information 
specifying the content of an operation of the mobile member 
or another apparatus, and for storing them, wherein, when it 
is determined according to the object information stored in 
the storage means that the positional relationship between 
the mobile member and the virtual object satisfies a 
predetermined condition, the mobile member or the another 
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apparatus is operated according to the operation information 
corresponding to the virtual object, stored in the storage 
means . 

[0031] 

With such a structure, it is determined according to 
the object information stored in the storage means whether a 
positional relationship between the mobile member and the 
virtual object satisfies a predetermined condition. As a 
result, when it is determined that the predetermined 
condition is satisfied, the mobile member or the another 
apparatus is operated according to operation information 
corresponding to the virtual object, stored in the storage 
means . 

The virtual object needs to have at least a logical 
location in a virtual space associated with an actual space, 
includes a virtual object at a point, which does not have a 
predetermined range, and also includes a virtual object 
which has a predetermined range but does not have a clear 
boundary. To configure an example virtual object having a 
predetermined area but not having a clear boundary, the RFID 
can be used. In this case, a non-contact- type tag from 
which the tag ID can be read in a non-contact manner is 
attached to the mobile member, and tag-ID reading means for 
reading the tag ID of a non-contact-type tag from the tag in 
a non-contact manner is provided. In other words, a space 
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in which the tag- ID reading means can read a tag ID 
constitutes a virtual object. The same points are applied 
to the service providing system, to the service providing 
programs, and to the service providing methods specified in 
the present invention. 
[0032] 

The predetermined condition is not limited to a 
condition that the location of the mobile member matches 
that of the virtual object. It includes, for example, a 
condition that the distance between the mobile member and 
the virtual object is a predetermined length or shorter, or 
a condition that a direction in which the virtual object 
sees the mobile member is a predetermined direction. The 
same points are applied to the service providing program and 
to the service providing methods specified in the present 
invention. 

Further, a service providing system according to the 
present invention is a service providing system for 
associating service with a virtual object, for disposing the 
virtual object in a virtual space associated with an actual 
space, and for providing service corresponding to the 
virtual object according to a positional relationship 
between a movable mobile member and the virtual object, 
including storage means for associating object information 
related to the virtual object with service information 
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specifying the content of service, and for storing them, 
wherein, when it is determined according to the object 
information stored in the storage means that the positional 
relationship between the mobile member and the virtual 
object satisfies a predetermined condition, the service 
corresponding to the virtual object is provided according to 
the service information stored in the storage means; and 
further including input means for performing an input 
related to generation, deletion, or update of the object 
information; and object-information processing means for 
generating, deleting, or updating the object information 
according to the content of the input performed by the input 
means . 

[0033] 

With such a structure, when it is determined according 
to the object information stored in the storage means that 
the positional relationship between the mobile member and 
the virtual object satisfies a predetermined condition, 
service corresponding to the virtual object is provided 
according to the service information stored in the storage 
means. When the user, the system administrator, or another 
person performs an input related to generation, deletion, or 
update of the object information through the input means, 
the object-information processing means generates, deletes, 
or updates the object information according to the content 
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of the input . 
[0034] 

To achieve the foregoing object, a management terminal 
according to the present invention is a terminal connected 
to the mobile member used in a service providing system 
according to the present invention in a communication- 
allowed manner, including a storage means, wherein, when the 
terminal receives the location information, it determines 
according to the received location information and the 
object information stored in the storage means whether the 
mobile member is disposed in the inside area of the virtual 
object identified by the shape and location of the virtual 
object . 

[0035] 

With such a structure, a function having the same level 
as the function of the management terminal in the service 
providing system according to the present invention is 
obtained. 

To achieve the foregoing object, a mobile member 
according to the present invention is a mobile member 
connected to the management terminal used in a service 
providing system according to the present invention in a 
communication-allowed manner, including a location- 
information acquisition means, wherein, when the mobile 
member receives the object information, it determines 
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according to the location information obtained by the 
location-information acquisition means and the received 
object information whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 
[0036] 

With such a structure, a function having the same level 
as the function of the mobile member in the service 
providing system according to the present invention is 
obtained. 

To achieve the foregoing object, a service providing 
program according to the present invention is a service 
providing program for associating service with a virtual 
object, for disposing the virtual object in a virtual space 
associated with an actual space, and for providing service 
corresponding to the virtual object according to a 
positional relationship between a movable mobile member and 
the virtual object, the program making a computer which is 
capable of using storage means for associating object 
information related to the shape and location of the virtual 
object with service information specifying a service content 
and for storing them, and location-information acquisition 
means for obtaining location information used for 
identifying the location of the mobile member, execute 
processing in which, when it is determined according to the 
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location information obtained by the location-information 
acquisition means and the object information stored in the 
storage means that the mobile member is disposed in the 
inside area of the virtual object identified by the shape 
and location of the virtual object, service corresponding to 
the virtual object is provided according to the service 
information stored in the storage means. 
[0037] 

With such a structure, when the computer reads the 
program and executes the processing according to the read 
program, the same function as that of the service providing 
system specified in the present invention is obtained. 

A service providing program according to the present 
invention is a service providing program for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, the program 
making a computer which is capable of using storage means 
for associating object information related to the virtual 
object with operation information specifying the content of 
an operation of the mobile member or another apparatus, and 
for storing them, execute processing in which, when it is 
determined according to the object information stored in the 
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storage means that the positional relationship between the 
mobile member and the virtual object satisfies a 
predetermined condition, the mobile member or the another 
apparatus is operated according to the operation information 
corresponding to the virtual object, stored in the storage 
means . 

[0038] 

With such a structure, when the computer reads the 
program and executes the processing according to the read 
program, the same function as that of the service providing 
system specified in the present invention is obtained. 

A service providing program according to the present 
invention is a service providing program for associating 
service with a virtual object, for disposing the virtual 
object in a virtual space associated with an actual space, 
and for providing service corresponding to the virtual 
object according to a positional relationship between a 
movable mobile member and the virtual object, the program 
making a computer which is capable of using storage means 
for associating object information related to the virtual 
object with service information specifying the content of 
service, and for storing them, execute processing in which, 
when it is determined according to the object information 
stored in the storage means that the positional relationship 
between the mobile member and the virtual object satisfies a 
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predetermined condition, the service corresponding to the 
virtual object is provided according to the service 
information stored in the storage means, and processing 
implemented as input means for performing an input related 
to generation, deletion, or update of the object 
information, and object-information processing means for 
generating, deleting, or updating the object information 
according to the content of the input performed by the input 
means . 

[0039] 

With such a structure, when the computer reads the 
program and executes the processing according to the read 
program, the same function as that of the service providing 
system specified in the present invention is obtained. 

To achieve the foregoing object, a service providing 
method according to the present invention is a service 
providing method for associating service with a virtual 
object, for disposing the virtual object in a virtual space 
associated with an actual space, and for providing service 
corresponding to the virtual object according to a 
positional relationship between a movable mobile member and 
the virtual object, the method including the steps of: 
associating object information related to the shape and 
location of the virtual object with service information 
specifying a service content and storing them; obtaining 
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location information used for identifying the location of 
the mobile member; and when it is determined according to 
the obtained location information and the object information 
that the mobile member is disposed in the inside area of the 
virtual object identified by the shape and location of the 
virtual object, providing service corresponding to the 
virtual object according to the service information. 
[0040] 

With such a structure, the same function as that of the 
service providing system specified in the present invention 
is obtained. 

To achieve the foregoing object, a service providing 
method according to the present invention is a service 
providing method for associating service with a virtual 
object, for disposing the virtual object in a virtual space 
associated with an actual space, and for providing service 
corresponding to the virtual object according to a 
positional relationship between a movable mobile member and 
the virtual object, the method including the steps of: 
associating object information related to the virtual object 
with operation information specifying the content of an 
operation of the mobile member or another apparatus, and 
storing them; and when it is determined according to the 
object information that the positional relationship between 
the mobile member and the virtual object satisfies a 
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predetermined condition, operating the mobile member or the 
another apparatus according to the operation information 
corresponding to the virtual object. 
[0041] 

With such a structure, the same function as that of the 
service providing system specified in the present invention 
is obtained. 

To achieve the foregoing object, a service providing 
method according to the present invention is a service 
providing method for associating service with a virtual 
object, for disposing the virtual object in a virtual space 
associated with an actual space, and for providing service 
corresponding to the virtual object according to a 
positional relationship between a movable mobile member and 
the virtual object, the method including the steps of: 
associating object information related to the virtual object 
with service information specifying the content of service, 
and for storing them; when it is determined according to the 
object information that the positional relationship between 
the mobile member and the virtual object satisfies a 
predetermined condition, providing the service corresponding 
to the virtual object according to the service information; 
and performing an input related to generation, deletion, or 
update of the object information, and generating, deleting, 
or updating the object information according to the content 
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of the input . 

With such a structure, the same function as that of the 
service providing system specified in the present invention 
is obtained. 

In the foregoing description, a service providing 
system, a management terminal, a mobile member, a service 
providing program, and a service providing method which 
achieve the foregoing object are provided. In addition to 
these things, first and second storage media, described 
below, can be provided to achieve the foregoing object. 

[0042] 

The first storage medium is a computer- readable storage 
medium storing a program to be applied to the management 
terminal according to the present invention. When the 
location information is received, the program makes a 
computer having or being capable of using the storage means 
execute processing for determining according to the received 
location information and the object information stored in 
the storage means whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 
[0043] 

With such a structure, when the program stored in the 
storage medium is read by a computer and the computer 
executes the read program, a function having the same level 
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and an advantage having the same level as the function and 
advantage obtained by the management terminal according to 
the present invention are obtained. 

The second storage medium is a computer- readable 
storage medium storing a program to be applied to the mobile 
member according to the present invention. When the object 
information is received, the program makes a computer having 
or being capable of using the location-information 
acquisition means execute processing for determining 
according to the location information obtained by the 
location-information acquisition means and the received 
object information whether the mobile member is disposed in 
the inside area of the virtual object identified by the 
shape and location of the virtual object. 

[0044] 

With such a structure, when the program stored in the 
storage medium is read by a computer and the computer 
executes the read program, a function having the same level 
and an advantage having the same level as the function and 
advantage obtained by the mobile member according to the 
present invention are obtained. 

[0045] 

[Description of the Embodiments] 

An embodiment of the present invention will be 
described below by referring to the drawings. Fig. 1 to 
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Fig. 14 are views showing a service providing system, a 
management terminal, a mobile member, a service providing 
program, and a service providing method according to an 
embodiment of the present invention. 

In the present embodiment, a service-providing system, 
a management terminal, a mobile member, a service providing 
program, and a service providing method according to the 
present invention are applied to a case in which in an art 
museum, as shown in Fig. 1 and Fig. 2, a virtual-object- 
setting apparatus 200 disposes and specifies cubic virtual 
objects A and B before pictures A and B exhibited on a wall 
surface, and capturing with a digital camera 300 is 
prohibited in the inside areas of the virtual objects A and 
B. 

[0046] 

The structure of a network system to which the present 
invention is applied will be described first by referring to 
Fig. 1 and Fig. 2. Fig. 1 and Fig. 2 are views showing the 
structure of the network system to which the present 
invention is applied. 

A virtual-object management apparatus 100 for managing 
virtual objects is placed, for example, as shown in Fig. 1, 
at an end of a wall surface in an art museum, and can bi- 
directionally communicate with the virtual-object-setting 
apparatus 200 for disposing and setting virtual objects, by 
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radio communication. The virtual-object-setting apparatus 
200 is formed of a personal digital assistant (PDA) , and is 
used by a staff member of the art museum in the present 
embodiment . 
[0047] 

The virtual-object management apparatus 100 can bi- 
directionally communicate by radio communication with the 
digital camera digital camera 300, which can capture images 
as digital data, as shown in Fig. 2. The digital camera 300 
can be automatically set by internal processing such that 
capturing is enabled or disabled, and is used by a visitor 
to the art museum in the present embodiment. 

The structure of the virtual-object management 
apparatus 100 will be described next in detail by referring 
to Fig. 3. Fig. 3 is a block diagram showing the structure 
of the virtual-object management apparatus 100. 

[0048] 

The virtual-object management apparatus 100 includes, 
as shown in Fig. 3, a CPU 30 for controlling calculations 
and the entire system according to a control program, a ROM 
32 for storing the control program used by the CPU 3 0 in a 
predetermined area in advance, a RAM 34 for storing data 
read from the ROM 32 and calculation results necessary in a 
calculation process of the CPU 30, and an interface (I/F) 38 
for sending and receiving data to and from external 
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apparatuses . These components are connected to each other 
in a data transferable manner through a bus 39 which is a 
signal line for transferring data. 
[0049] 

The interface (I/F) 38 is connected to external 
apparatuses; a radio communication apparatus 40 for 
communicating with the virtual -object-setting apparatus 200 
and the digital camera 300 by radio communication, a 
virtual-object management data base (hereinafter, a data 
base is abbreviated as a DB) 42 for registering and managing 
object information related to virtual objects, and a display- 
apparatus 44 for displaying a screen according to an image 
signal . 

The virtual-object management DB 42 stores a virtual- 
object management table 400 in which object information 
related to the shapes and locations of virtual objects can 
be registered correspondingly to service information which 
specifies service contents, as shown in Fig. 4. Fig. 4 is a 
view showing the data structure of the virtual-object 
managemen t table 400. 

[0050] 

In the virtual -object management table 400, as shown in 
Fig. 4, one record can be registered for each virtual 
object. Each record includes a field 402 for registering a 
serial number, a field 404 for registering coordinates 
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indicating the location of the virtual object in a virtual 
space corresponding to an actual space, a field 406 for 
registering the shape of the virtual object, a field 408 for 
registering the size of the virtual object, a field 410 for 
registering an action to be associated with the virtual 
object, and a field 412 for registering supplementary 
information for the virtual object. The data in the fields 
404, 406, and 408 correspond to object information, and the 
data in the fields 410 and 412 correspond to service 
information. 
[0051] 

In the example shown in Fig. 4, at a first-row record, 
a serial number of "1" is input in the field 402, 
coordinates of "(10, 50, 20)" in the field 404, a size of 
"cube" is in the field 406, a size of "5 m" in the field 
408, an action of "capturing prohibition" in the field 410, 
and a supplementary information of "Null" in the field 412. 
This record means that a cubic virtual object having a side 
length of 5 m is virtually disposed with coordinates (10, 
50, 20) being assigned to its center, and capturing with the 
digital camera 3 00 is prohibited in the inside area of the 
virtual object identified by its location and shape. 
Supplementary information of "Null" indicates that there is 
no supplementary information. 
[0052] 



- 47 - 



The CPU 30 is formed of a microprocessing unit MPU, 
activates a predetermined program stored at a predetermined 
area in the ROM 32, and executes in a time-division manner 
virtual-object generating processing, virtual-object 
deleting processing, virtual-object updating processing and 
object-information transmitting processing shown in 
flowcharts of Fig. 5 to Fig. 8, according to the program. 

The virtual-object generating processing will be 
described first in detail by referring to Fig. 5. Fig. 5 is 
a flowchart showing the virtual-object generating 
processing. 

[0053] 

The virtual-object generating processing disposes and 
sets a virtual object according to a generation request sent 
from the virtual-object-setting apparatus 200. When the CPU 
3 0 starts executing the processing, the processing proceeds 
to step S112 as shown in Fig. 5. 

in step S112, it is determined whether a request for 
generating a virtual object has been received. When it is 
determined that a generation request has been received 
(Yes), the processing proceeds to step S114, and otherwise 
(No) , the processing awaits in step S112 until a generation 
request is received. 
[0054] 

In step S114, object information and service 
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information are received. The processing proceeds to step 
S116, and the received object information is associated with 
the service information, and they are registered into the 
virtual-object management table 400. The processing 
proceeds to step S118, and a notice of completion of the 
generation of the virtual object is sent to the virtual- 
object-setting apparatus 200, a series of processes are 
terminated, and the processing returns to the original 
processing. 

The virtual-object deleting processing will be 
described next in detail by referring to Fig. 6. Fig. 6 is 
a flowchart showing the virtual-object deleting processing. 

[0055] 

The virtual-object deleting processing deletes a 
virtual object according to a deletion request sent from the 
virtual-object-setting apparatus 200. When the CPU 30 
starts executing the processing, the processing proceeds to 
step S206, as shown in Fig. 6. 

In step S2 06, it is determined whether a request for 
deleting a virtual object has been received. When it is 
determined that a deletion request has been received (Yes) , 
the processing proceeds to step S208, and otherwise (No), 
the processing awaits in step S206 until a deletion request 
is received. 

[0056] 
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In step S208, location information is received. The 
processing proceeds to step S210, and the virtual-object 
management table 400 is searched according to the received 
location information for the corresponding object 
information. More specifically, in step S208, the object 
information of a virtual object (s) disposed within a 
predetermined distance (such as 10 m) from the location of 
the virtual-object-setting apparatus 200, specified by the 
location information is searched for. The virtual object (s) 
corresponding to the found object information is to be 
deleted. In other words, the virtual-object-setting 
apparatus 200 needs to move into the inside area of the 
virtual object (s) to be deleted or close to the area in 
order to delete the virtual object. 
[0057] 

Then, the processing proceeds to step S211, and a list 
of virtual objects to be deleted is generated according to 
the found object information. The processing proceeds to 
step S212, and the generated list of virtual objects is sent 
to the virtual-object-setting apparatus 200. The processing 
proceeds to step S222. 

In step S222, it is determined whether a request for 
deleting virtual objects according to the list of virtual 
objects has been received. When it is determined that a 
deletion request has been received (Yes) , the processing 
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proceeds to step S224, the object information and the 
service information of the virtual objects to be deleted are 
deleted. The processing proceeds to step S222. 
[0058] 

When it is determined in step S222 that a deletion 
request has not yet been received (No) , the processing 
proceeds to step S230, and it is determined whether a 
termination request for terminating the deletion of virtual 
objects has been received. When it is determined that a 
termination request has been received (Yes), the processing 
proceeds to step S232, a notice of completion of the 
deletion of the virtual objects is sent to the virtual- 
object-setting apparatus 200, a series of processes is 
finished, and the processing returns to the original 
processing. 

When it is determined in step S230 that a termination 
request has not yet been received (No) , the processing 
proceeds to step S222. 
[0059] 

The virtual-object updating processing will be 
described next in detail by referring to Fig. 7. Fig. 7 is 
a flowchart showing the virtual-object updating processing. 

The virtual-object updating processing updates a 
virtual object according to an update request sent from the 
virtual-object-setting apparatus 200. When the CPU 30 
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starts executing the processing, the processing proceeds to 
step S306, as shown in Fig. 7. 
[0060] 

In step S3 06, it is determined whether a request for 
updating a virtual object has been received. When it is 
determined that an update request has been received (Yes) , 
the processing proceeds to step S308, and otherwise (No), 
the processing awaits at step S3 06 until an update request 
is received. 

In step S308, location information is received. The 
processing proceeds to step S308, and the virtual-object 
management table 400 is searched according to the received 
location information for the corresponding object 
information. More specifically, in step S310, the object 
information of a virtual object (s) disposed within a 
predetermined distance from the location of the virtual- 
object-setting apparatus 200, specified by the location 
information is searched for. The virtual object (s) 
corresponding to the found object information is to be 
updated. In other words, the virtual-object-setting 
apparatus 2 00 needs to move into the inside area of the 
virtual object (s) to be updated or close to the area in 
order to update the virtual object. 

[0061] 

Then, the processing proceeds to step S311, and a list 
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of virtual objects to be updated is generated according to 
the found object information. The processing proceeds to 
step S312, and the generated list of virtual objects is sent 
to the virtual-object-setting apparatus 200. The processing 
proceeds to step S328. 

In step S328, it is determined whether a request for 
updating virtual objects according to the list of virtual 
objects has been received. When it is determined that a 
update request has been received (Yes), the processing 
proceeds to step S330, and object information and service 
information are received. The processing proceeds to step 
S332, and the object information and the service information 
of virtual objects to be updated are updated according to 
the received object information and the received service 
information. The processing proceeds to step S328. 

[0062] 

When it is determined in step S328 that an update 
request has not yet been received (No) , the processing 
proceeds to step S33 8, and it is determined whether a 
termination request for terminating the update of virtual 
objects has been received. When it is determined that a 
termination request has been received (Yes) , the processing 
proceeds to step S340, a notice of completion of the update 
of the virtual objects is sent to the virtual-object-setting 
apparatus 2 00, a series of processes is finished, and the 
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processing returns to the original processing. 

When it is determined in step S3 3 8 that a termination 
request has not yet been received (No) , the processing 
proceeds to step S328. 
[0063] 

The object-information transmitting processing will be 
described next in detail by referring to Fig. 8. Fig. 8 is 
a flowchart showing the object-information transmitting 
processing. 

The object-information transmitting processing 
transmits object information stored in the virtual-object 
management DB 42 according to a transmission request sent 
from the digital camera 300. When the CPU 30 starts 
executing the processing, the processing proceeds to step 
S404, as shown in Fig. 8. 
[0064] 

In step S404, it is determined whether a request for 
transmitting object information has been received. When it 
is determined that a transmission request has been received 
(Yes), the processing proceeds to step S406, and otherwise 
(No) , the processing awaits at step S404 until a 
transmission request is received. 

In step S406, location information is received. The 
processing proceeds to step S408, and the virtual-object 
management table 400 is searched according to the received 



- 54 - 



location information for the corresponding object 
information. More specifically, in step S408, the object 
information of a virtual object (s) disposed within a 
predetermined distance from the location of the virtual- 
object-setting apparatus 200, specified by the location 
information is searched for. The found object information 
is to be transmitted. 
[0065] 

Then, the processing proceeds to step S410, the found 
object information and the service information corresponding 
thereto are transmitted to the digital camera 3 00, a series 
of processes is finished, and the processing returns to the 
original processing. 

The structure of the virtual-object-setting apparatus 
200 will be described in detail by referring to Fig. 9. 
Fig. 9 is a block diagram showing the structure of the 
virtual-object-setting apparatus 200. 

[0066] 

The virtual-object-setting apparatus 200 includes, as 
shown in Fig. 9, a CPU 50 for controlling calculations and 
the entire system according to a control program, a ROM 52 
for storing the control program used by the CPU 50 in a 
predetermined area in advance, a RAM 54 for storing data 
read from the ROM 52 and calculation results necessary in a 
calculation process of the CPU 50, and an interface (I/F) 58 
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for sending and receiving data to and from external 
apparatuses . These components are connected to each other 
in a data transferable manner through a bus 59 which is a 
signal line for transferring data. 
[0067] 

The interface (I/F) 58 is connected to external 
apparatuses; a radio communication apparatus 60 for 
communicating with the virtual-object management apparatus 
100 by radio communication, a key panel 62 serving as a 
human interface for allowing data to be input by a plurality 
of keys, a liquid-crystal display (LCD) 64 for displaying a 
screen according to an image signal, and a location- 
information acquisition apparatus 66 for measuring the 
current location of the virtual-object-setting apparatus 200 
to obtain location information identifying the location. 
[0068] 

The location-information acquisition apparatus 66 
receives from non-geostationary satellites for sending time 
signals indicating the current time the time signals, 
measures the location of the current point by using a so- 
called GPS for measuring a location according to the 
differences between the times indicated by the time signals 
and the orbits of the non-geostationary satellites, and 
outputs the measured location of the current point as 
location information. 



- 56 - 



The CPU 50 is formed of a microprocessing unit MPU, 
activates a predetermined program stored at a predetermined 
area in the ROM 52, and executes in a time-division manner 
virtual-object-generation request processing, virtual- 
object-deletion request processing, and virtual-object- 
update request processing shown in flowcharts of Fig. 10 to 
Fig. 12, according to the program. 
[0069] 

The virtual-object-generation request processing will 
be described first in detail by referring to Fig. 10. Fig. 
10 is a flowchart showing the virtual-object-generation 
request processing. 

The virtual -object-generation request processing 
corresponds to the virtual-object generating processing 
shown in Fig. 5, requests the virtual-object management 
apparatus 100 to generate a virtual object. When the CPU 50 
starts executing the processing, the processing proceeds to 
step S100 as shown in Fig. 10. 
[0070] 

In step S100, it is determined whether the user of the 
virtual-object-setting apparatus 2 00 has instructed the 
generation of a virtual object. When it is determined that 
the generation of a virtual object has been instructed 
(Yes), the processing proceeds to step S102, and otherwise 
(No) , the processing awaits in step S100 until the 
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generation of a virtual object is instructed. 

In step S102, location information is obtained from the 
location-information acquisition apparatus 66. The 
processing proceeds to step S104, and an action to be 
associated with the virtual object is selected from among a 
plurality of actions through the key panel 62 . Actions 
which can be selected include an action for prohibiting 
capturing and an action for indicating a description. 

[0071] 

Then, the processing proceeds to step S106, and the 
shape and size of the virtual object are input from the key 
panel 62. The processing proceeds to step S108, and object 
information and service information are generated according 
to the obtained location information and the selection 
result and the input result of steps S104 and S106. The 
processing proceeds to step S110, and a request for 
generating the virtual object is sent together with the 
generated object information and the generated service 
information to the virtual-object management apparatus 100. 
The processing proceeds to step S120. 
[0072] 

In step S120, it is determined whether a notice of 
completion of the generation of the virtual object has been 
received. When it is determined that a generation- 
completion notice has been received (Yes), the processing 
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proceeds to step S122, a message indicating that the 
generation of the virtual object has been completed is shown 
in the LCD 64, a series of processes are terminated, and the 
processing returns to the original processing. 

On the other hand, when it is determined in step S120 
that a generation completion notice has not yet been 
received (No) , the processing awaits in step S120 until a 
generation completion notice is received. 

[0073] 

The virtual-object-deletion request processing will be 
described next in detail by referring to Fig. 11. Fig. 11 
is a flowchart showing the virtual-object-deletion request 
processing. 

The virtual-object-deletion request processing 
corresponds to the virtual-object deleting processing shown 
in Fig. 6, requests the virtual-object management apparatus 
100 to delete a virtual object. When the CPU 50 starts 
executing the processing, the processing proceeds to step 
S200 as shown in Fig. 11. 
[0074] 

In step S200, it is determined whether the user has 
instructed the deletion of a virtual object. When it is 
determined that the deletion of a virtual object has been 
instructed (Yes), the processing proceeds to step S202, and 
otherwise (No) , the processing awaits in step S2 00 until the 



- 59 - 



deletion of a virtual object is instructed. 

In step S202, location information is obtained from the 
location-information acquisition apparatus 66. The 
processing proceeds to step S204, and a request for deleting 
the virtual object is sent together with the obtained 
location information to the virtual-object management 
apparatus 100. The processing proceeds to step S214. 

[0075] 

In step S214, it is determined whether a list of 
virtual objects has been received. When it is determined 
that a list of virtual objects has been received (Yes), the 
processing proceeds to step S216, and the received list of 
virtual objects is displayed on the LCD 64. The processing 
proceeds to step S218. 

In step S218, it is determined whether a virtual object 
to be deleted has been selected from the list of virtual 
objects. When it is determined that a virtual object to be 
deleted has been selected from the list (Yes), the 
processing proceeds to step S220, and a request for deleting 
the virtual object according to the list of virtual objects 
is sent to the virtual-object management apparatus 100. The 
processing proceeds to step S218. 

[0076] 

On the other hand, in step S218, when it is determined 
that a virtual object has not yet been selected (No) , the 
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processing proceeds to step S226, and it is determined 
whether the user has instructed a deletion termination of a 
virtual object. When it is determined that a deletion 
termination of a virtual object has been instructed (Yes), 
the processing proceeds to step S22 8, and a termination 
request for terminating the deletion of a virtual object is 
sent to the virtual-object management apparatus 100. The 
processing proceeds to step S234. 
[0077] 

In step S234, it is determined whether a notice of 
completion of the deletion of the virtual object has been 
received. When it is determined that a deletion-completion 
notice has been received (Yes), the processing proceeds to 
step S23 6, a message indicating that the deletion of the 
virtual object has been completed is shown in the LCD 64, a 
series of processes are terminated, and the processing 
returns to the original processing. 

On the other hand, when it is determined in step S234 
that a deletion-completion notice has not yet been received 
(No) , the processing awaits in step S234 until a deletion- 
completion notice is received. 

[0078] 

On the other hand, in step S22 6, when it is determined 
that a deletion termination of a virtual object has not yet 
been instructed (No), the processing proceeds to step S218. 
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On the other hand, when it is determined in step S214 
that the list of virtual objects has not yet been received 
(Yes), the processing awaits in step S214 until the list of 
virtual objects is received. 

The virtual-object-update request processing will be 
described next in detail by referring to Fig. 12. Fig. 12 
is a flowchart showing the virtual-object-update request 
processing. 

[0079] 

The virtual-object-update request processing 
corresponds to the virtual-object updating processing shown 
in Fig. 7, requests the virtual-object management apparatus 
100 to update a virtual object. When the CPU 50 starts 
executing the processing, the processing proceeds to step 
S300 as shown in Fig. 12. 

In step S3 00, it is determined whether the user has 
instructed the update of a virtual object. When it is 
determined that the update of a virtual object has been 
instructed (Yes), the processing proceeds to step S3 02, and 
otherwise (No) , the processing awaits in step S3 00 until the 
update of a virtual object is instructed. 

[0080] 

In step S3 02, location information is obtained from the 
location-information acquisition apparatus 66. The 
processing proceeds to step S3 04, and a request for updating 
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the virtual object is sent together with the obtained 
location information to the virtual-object management 
apparatus 100. The processing proceeds to step S314. 

In step S314, it is determined whether a list of 
virtual objects has been received. When it is determined 
that a list of virtual objects has been received (Yes), the 
processing proceeds to step S316, and the received list of 
virtual objects is displayed on the LCD 64. The processing 
proceeds to step S318. 
[0081] 

In step S3 18, it is determined whether a virtual object 
to be updated has been selected from the list of virtual 
objects. When it is determined that a virtual object to be 
updated has been selected from the list (Yes) , the 
processing proceeds to step S320, and an action to be 
associated with the virtual object is selected from a 
plurality of actions. The processing proceeds to step S322, 
and the shape and size of the virtual object are input from 
the key panel 62. The processing proceeds to step S324, and 
object information and service information are generated 
according to the obtained location information and the 
selection result and the input result of step S320 and step 
S322. The processing proceeds to step S326, the generated 
object information and the generated service information are 
sent together with a request for updating the virtual object 
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according to the list of virtual objects to the virtual- 
object management apparatus 100. The processing proceeds to 
step S318. 
[0082] 

On the other hand, in step S318, when it is determined 
that a virtual object has not yet been selected (No) , the 
processing proceeds to step S334, and it is determined 
whether the user has instructed an update termination of a 
virtual object. When it is determined that an update 
termination of a virtual object has been instructed (Yes), 
the processing proceeds to step S33 6, and a termination 
request for terminating the update of a virtual object is 
sent to the virtual-object management apparatus 100. The 
processing proceeds to step S342. 

[0083] 

In step S342, it is determined whether a notice of 
completion of the update of the virtual object has been 
received. When it is determined that an update-completion 
notice has been received (Yes) , the processing proceeds to 
step S344, a message indicating that the update of the 
virtual object has been completed is shown in the LCD 64, a 
series of processes are terminated, and the processing 
returns to the original processing. 

On the other hand, when it is determined in step S342 
that an update-completion notice has not yet been received 
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(No) , the processing awaits in step S342 until an update- 
completion notice is received. 
[0084] 

On the other hand, in step S334, when it is determined 
that an update termination of a virtual object has not yet 
been instructed (No), the processing proceeds to step S318. 

On the other hand, when it is determined in step S3 14 
that the list of virtual objects has not yet been received 
(Yes), the processing awaits in step S314 until the list of 
virtual objects is received. 

The structure of the digital camera 300 will be 
described next in detail by referring to Fig. 13. Fig. 13 
is a block diagram showing the structure of the digital 
camera 300. 

[0085] 

The digital camera 3 00 includes, as shown in Fig. 13, a 
CPU 7 0 for controlling calculations and the entire system 
according to a control program, a ROM 72 for storing the 
control program used by the CPU 7 0 in a predetermined area 
in advance, a RAM 74 for storing data read from the ROM 72 
and calculation results necessary in a calculation process 
of the CPU 70, and an interface (I/F) 78 for sending and 
receiving data to and from external apparatuses . These 
components are connected to each other in a data 
transferable manner through a bus 79 which is a signal line 
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for transferring data. 
[0086] 

The interface (I/F) 78 is connected to external 
apparatuses; a radio communication apparatus 80 for 
communicating with the virtual-object management apparatus 
100 by radio communication, a key panel 82 serving as a 
human interface for allowing data to be input by a plurality 
of keys, a liquid-crystal display (LCD) 84 for displaying a 
screen according to an image signal, a location-information 
acquisition apparatus 86 for measuring the current location 
of the digital camera 300 to obtain location information 
identifying the location, and a capturing apparatus 88 for 
capturing images as digital data. 

[0087] 

The CPU 70 is formed of a microprocessing unit MPU, 
activates a predetermined program stored at a predetermined 
area in the ROM 72, and executes object-information- 
transmission request processing shown in a flowchart of Fig. 
14, according to the program. Fig. 14 is a flowchart 
showing the object-information- transmission request 
processing. 

The object-information- transmission request processing 
corresponds to the object-information transmitting 
processing shown in Fig. 8, and requests the virtual -object 
management apparatus 100 to send object information and 
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service information. When the CPU 70 starts executing the 
processing, the processing proceeds to step S400 as shown in 
Fig. 14. 

[0088] 

In step S400, location information is obtained from the 
location-information acquisition apparatus 86. The 
processing proceeds to step S402, and the obtained location 
information is sent together with a request for transmitting 
object information to the virtual-object management 
apparatus 100. The processing proceeds to step S412. 

In step S412, it is determined whether object 
information and service information have been received. 
When it is determined that object information and service 
information have been received (Yes), the processing 
proceeds to step S414, and interpretation processing for 
interpreting the received object information and the 
received service information is executed. The request 
processing proceeds to step S416. 

[0089] 

In step S416, it is determined according to the 
interpretation result of step S414 whether the digital 
camera 3 00 is disposed in the inside area of the virtual 
object. When it is determined that the digital camera 300 
is disposed in the inside area of the virtual object (Yes), 
the processing proceeds to step S418, and it is determined 
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whether an action associated with the virtual object is 
capturing prohibition. When it is determined that the 
action is capturing prohibition (Yes) , the processing 
proceeds to step S420, and capturing with the capturing 
apparatus 88 is made to be prohibited. The processing 
proceeds to step S422. 
[0090] 

In step S422, it is determined whether the action 
associated with the virtual object is the indication of a 
description. When it is determined that the action is the 
indication of a description (Yes) , the processing proceeds 
to step S424, supplementary information included in the 
service information is displayed on the LCD 84, a series of 
processes is terminated, and the processing proceeds to the 
original processing. 

On the other hand, in step S422, when it is determined 
that the action associated with the virtual object is not 
the indication of a description (No) , the series of 
processes is terminated, and the processing proceeds to the 
original processing. 
[0091] 

On the other hand, in step S418, when it is determined 
that the action associated with the virtual object is not 
capturing prohibition (No) , the processing proceeds to step 
S422 . 
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On the other hand, in step S416, it is determined that 
the digital camera 3 00 is not disposed in the inside area of 
the virtual object (No) , the processing proceeds to step 
S426, and it is determined whether capturing has been 
prohibited. When it is determined that capturing has been 
prohibited (Yes), the processing proceeds to step S428, the 
prohibition of capturing is released, the series of 
processes is terminated, and the processing proceeds to the 
original processing. 
[0092] 

On the other hand, in step S426, when it is determined 
that the prohibition of capturing has not been set (No) , the 
series of processes is terminated, and the processing 
proceeds to the original processing. 

On the other hand, in step S412, when it is determined 
that object information and service information have not 
been received (No) , the processing awaits in step S412 until 
object information and service information are received. 

Operations in the above-described embodiment will be 
described next. 
[0093] 

A case in which a virtual object is generated will be 
described first. 

A staff member of the art museum uses the virtual- 
object-setting apparatus 200 to generate a virtual object. 
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The staff member first instructs the virtual-object-setting 
apparatus 200 to generate a virtual object. 

When the user instructs the generation of a virtual 
object, the virtual-object-setting apparatus 2 00 obtains 
location information from the location-information 
acquisition apparatus 66 and requests the user to select an 
action to be associated with the virtual object through step 
S102 and step S104. In response to the selection request, 
the user selects an action to be associated with the virtual 
object from a plurality of actions. In this case, since the 
staff member of the art museum wants to prohibit capturing 
of the pictures A and B, the staff member selects the 
prohibition of capturing as an action to be associated with 
the virtual object. 

[0094] 

When the action is selected, the virtual-object-setting 
apparatus 200 requests the user to input the shape and size 
of the virtual object through step S106. In response to the 
input request, the user inputs the shape and size of the 
virtual object. In this case, since the staff member of the 
art museum wants to prohibit capturing of the pictures A and 
B, the staff member inputs a cubic shape which includes a 
viewing area and an appropriate size. In the example shown 
in Fig. 1, cubic virtual objects A and B are specified in 
front of the pictures A and B, respectively. 
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[0095] 

When the shape and size of the virtual object are 
input, the virtual-object-setting apparatus 200 generates 
object information and service information according to the 
obtained location information and the selection result and 
the input result of step S104 and step S106, and sends a 
generation request together with the generated object 
information and the generated service information to the 
virtual-object management apparatus 100 through step S108 
and step S110. 

[0096] 

When the virtual-object management apparatus 100 
receives the generation request, it receives the object 
information and the service information, associates the 
object information with the service information and stores 
them in the virtual-object management table 400, and sends a 
notice of completion of the generation of the virtual object 
to the virtual-object-setting apparatus 200 through step 
S114 to step S118. 

When the virtual-object-setting apparatus 200 receives 
the generation-completion notice, it displays a message 
indicating that the generation of the virtual object has 
been completed through step S122. 

[0097] 

A case in which an attempt is made by a viewer having 
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the digital camera 3 00 to capture the pictures A and B near 
them will be described next. 

When the viewer having the digital camera 3 00 comes 
close to the pictures A and B in a condition in which the 
virtual objects A and B have been specified as described 
above, the digital camera 300 obtains location information 
from the location-information acquisition apparatus 86, and 
sends a transmission request together with the obtained 
location information to the virtual-object management 
apparatus virtual-object management apparatus 100 through 
steps S400 and S402. 

[0098] 

When the virtual -object management apparatus 100 
receives the transmission request, it receives the location 
information, and searches the virtual-object management 
table 400 according to the received location information for 
the corresponding object information through step S406 and 
step S408. In this case, the object information of the 
virtual objects A and B are found. The virtual-object 
management apparatus 100 sends the found object information 
and the service information corresponding thereto to the 
digital camera 300 through step S410. 

[0099] 

When the digital camera 3 00 receives the object 
information and the service information, it interprets the 
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received object information and the received service 
information, and determines according to the interpretation 
result that the digital camera 300 is disposed in the inside 
area of the virtual object, through step S414 and step S416. 
In this case, since the viewer is located close to the 
pictures A and B, the digital camera 300 is disposed in the 
inside area of a virtual object. Therefore, through steps 
S418 and S420, the prohibition of capturing by the use of 
the capturing apparatus 88 is specified. 
[0100] 

Consequently, in this state, the viewer cannot capture 
the pictures A and B by the use of the digital camera 300. 

When the viewer moves away from the inside areas of the 
virtual objects A and B, the digital camera 3 00 receives 
object information and service information. Since it is 
determined that the digital camera 3 00 is not disposed in 
the inside areas of the virtual objects, the prohibition of 
capturing is released through steps S416, S426, and S428. 

[0101] 

In the above example, an action of the prohibition of 
capturing has been associated with the virtual objects. 
When an action of the indication of a description is 
associated, for example, the digital camera 300 performs the 
same processes up to step S416, and then, indicates 
descriptions of the pictures A and B through steps S422 and 
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S424. 

A case in which a virtual object is deleted will be 
described next. 

A staff member of the art museum uses the virtual- 
object-setting apparatus 2 00 to delete a virtual object. 
The staff member first moves to a place where the virtual 
objects A and B have been specified, and instructs the 
virtual-object-setting apparatus 200 to delete the virtual 
objects . 

[0102] 

When the virtual-object-setting apparatus 200 receives 
a user instruction of the deletion of the virtual objects, 
it receives location information from the location- 
information acquisition apparatus 66, and sends a deletion 
request together with the obtained location information to 
the virtual-object management apparatus 100 through steps 
S202 and S204. 

When the virtual -object management apparatus 100 
receives the deletion request, it receives the location 
information, and searches the virtual -object management 
table 400 according to the received location information for 
the corresponding object information through steps S208 and 
S210. In this case, the object information of the virtual 
objects A and B is found. Then, a list of virtual objects 
to be deleted is generated according to the found object 
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information, and the generated list of virtual objects is 
sent to the virtual-object-setting apparatus 200 through 
steps S211 and S212. 
[0103] 

When the virtual-object-setting apparatus 2 00 receives 
the list of virtual objects, it displays the received list 
of virtual objects through step S216, and requests the user 
to select a virtual object to be deleted. In response to 
the selection request, the user selects, for example, the 
virtual object A. 

When the object to be deleted is selected, the virtual- 
object-setting apparatus 200 sends a deletion request and a 
deletion object of the virtual object A to the virtual- 
object management apparatus 100 through step S220. 

[0104] 

When the virtual -object management apparatus 100 
receives a deletion object of the virtual object A and the 
deletion request, it deletes the object information and the 
service information of the virtual object selected as an 
object to be deleted, through step S224. When the virtual- 
object management apparatus 100 receives a termination 
request from the virtual-object-setting apparatus 200, it 
sends a deletion-completion notice to the virtual-object- 
setting apparatus 200 through step S232. 

When the virtual-object-setting apparatus 200 receives 
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the deletion-completion notice, it displays a message 
indicating that the virtual object has been deleted, through 
step S232. 
[0105] 

A case in which a virtual object is updated will be 
described next. 

A staff member of the art museum uses the virtual- 
object-setting apparatus 200 to update a virtual object. 
The staff member first moves to a place where the virtual 
objects A and B have been specified, and instructs the 
virtual-object-setting apparatus 200 to update the virtual 
objects . 

When the virtual-object-setting apparatus 200 receives 
a user instruction of the update of the virtual objects, it 
receives location information from the location-information 
acquisition apparatus 66, and sends an update request 
together with the obtained location information to the 
virtual-object management apparatus 100 through steps S302 
and S3 04. 

[0106] 

When the virtual-object management apparatus 100 
receives the update request, it receives the location 
information, and searches the virtual-object management 
table 400 according to the received location information for 
the corresponding object information through steps S3 08 and 
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S310. In this case, the object information of the virtual 
objects A and B is found. Then, a list of virtual objects 
to be updated is generated according to the found object 
information, and the generated list of virtual objects is 
sent to the virtual-object-setting apparatus 200 through 
steps S311 and S312 . 
[0107] 

When the virtual-object-setting apparatus 200 receives 
the list of virtual objects, it displays the received list 
of virtual objects through step S316, and requests the user 
to select a virtual object to be updated. In response to 
the selection request, the user selects, for example, the 
virtual object B as an object to be updated, and inputs an 
update content for the virtual object B, selected. 
[0108] 

When the object to be updated is selected and the 
update content is input, the virtual-object-setting 
apparatus 200 generates object information and service 
information according to the obtained location information, 
and the selection result and the input result of steps S320 
and S322, and sends the generated object information and the 
generated service information to the virtual-object 
management apparatus 100 together with an update object of 
the virtual object B and a update request, through steps 
S324 and S326. 
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[0109] 

When the virtual -object management apparatus 100 
receives an update object of the virtual object B and the 
update request, it receives the object information and the 
service information, and updates the object information and 
the service information of the virtual object selected as an 
object to be updated, according to the received object 
information and the received service information, through 
steps S330 and S332. Then, when the virtual-object 
management apparatus 100 receives a termination request from 
the virtual-object-setting apparatus 200, it sends an 
update-completion notice to the virtual-object-setting 
apparatus 200 through step S3 40. 
[0110] 

When the virtual-object-setting apparatus 200 receives 
the update-completion notice, it displays a message 
indicating that the virtual object has been updated, through 
the step S344. 

As described above, in the present embodiment, the 
virtual -object management apparatus 100 associates object 
information related to the shape and the location of a 
virtual object with service information and stores them, and 
sends the object information and the service information 
stored in the virtual-object management DB 42 to the digital 
camera 3 00 in response to a transmission request sent from 
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the digital camera 300. When the digital camera 300 
determines from the obtained location information and the 
received object information that the digital camera 3 00 is 
disposed in the inside area of the virtual object identified 
by the shape and location of the virtual object, it executes 
an action corresponding to the virtual object, according to 
the received service information. 
[0111] 

With these operations, a virtual object has a shape and 
a location, and it is determined whether the digital camera 
3 00 is disposed in the inside area of the virtual object. 
Since an area where service is provided is relatively 
clarified compared with a conventional case, different 
services can be provided in fine units, such as in units of 
several meters. In addition, since an area where service is 
provided is not a point but has a predetermined range, the 
user is more likely to receive the service. 
[0112] 

Further, in the present embodiment, the virtual-object 
management apparatus 100 associates object information with 
service information which specifies the contents of an 
action of the digital camera 300 and stores them. When the 
digital camera 300 determines according to obtained location 
information and received object information that the digital 
camera 3 00 is disposed in the inside area of a virtual 
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object, capturing with the use of the digital camera 300 is 
prohibited according to received service information. 
[0113] 

With these operations, since the operation of the 
digital camera 3 00 is controlled according to the movement 
of the user, not only an information providing service but a 
variety of services can be received. In the present 
embodiment, the art museum receives a service of capturing 
prohibition. 

In addition, in the present embodiment, the virtual- 
object management apparatus 100 performs an input related to 
creation, deletion, or update of object information, 
according to communication with the virtual-object-setting 
apparatus 2 00, and creates, deletes, or updates object 
information according to the contents of the input. 

[0114] 

Therefore, since it becomes easier to create, delete, 
or update virtual objects, the art museum can relatively 
flexibly handle a change in situation, such as a location 
shift of an exhibition or an increase or decrease of the 
number of exhibitions. 

Further, in the present embodiment, the digital camera 
3 00 performs the analysis processing of object information. 

Therefore, the processing load of the virtual-object 
management apparatus 100 is reduced. 
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[0115] 

Furthermore, in the present embodiment, the digital 
camera 3 00 executes an action. 

Therefore, the processing load of the virtual-object 
management apparatus 100 is reduced. 

In the above embodiment, service information 
corresponds to action information or to media information; 
the virtual-object management apparatus 100 corresponds to a 
management terminal; and the digital camera 3 00 corresponds 
to a mobile member, or to a portable terminal. The virtual- 
object management DB 42 corresponds to storage means; the 
location-information acquisition apparatus 86 corresponds to 
location-information acquisition means; and steps S112, 
S114, S206, S222, S306, S328, and S330 correspond to input 
means . 

[0116] 

In the above embodiment, steps S116, S224, and S332 
correspond to object- information processing means. 

In the above embodiment, the analysis processing of 
object information is performed by the digital camera 300. 
The configuration is not limited to this case. The analysis 
processing of object information may be performed by the 
virtual-object management apparatus 100. 

With this configuration, the processing load of the 
digital camera 3 00 is reduced. 
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[0117] 

In the above embodiment, the execution of an action is 
performed by the digital camera 300. The configuration is 
not limited to this case. The execution of an action may be 
performed by the virtual-object management apparatus 100. 

In this case, the processing load of the digital camera 
300 is reduced. 

In the above embodiment, one action is associated with 
one virtual object. Association is not limited to this 
case. A plurality of actions (actions of capturing 
prohibition and indication of a description in the above 
embodiment) may be associated with one virtual object. 

[0118] 

In the above embodiment, the present invention is 
applied to a case in which capturing pictures is prohibited 
in an art museum. The following variations can be proposed. 

In a first variation, when an action of printing at a 
printer is associated with a virtual object, and the virtual 
object is virtually disposed in an area which includes the 
printer, for example, when a person who carries the digital 
camera 3 00 approaches the printer, capturing data of the 
digital camera 3 00 is automatically printed. In this case, 
if a confirmation and a response are sent to and from the 
user of the digital camera 300 before printing, it is more 
convenient . 
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[0119] 

In a second variation, when an action of displaying an 
advertisement is associated with a virtual object, and the 
virtual object is disposed, for example, at an entrance of a 
building having a shopping mall, if a person having a 
portable telephone having the function of the above digital 
camera passes through the entrance of the building, an 
advertisement of a shop in the shopping mall is displayed on. 
the portable terminal . 

In the above embodiment, when the digital camera 3 00 
determines according to the interpretation result of step 
S414 that the digital camera 3 00 is not disposed in the 
inside area of a virtual object, capturing prohibition is 
released. Release of capturing prohibition is not limited 
to this case. When a viewer goes away from the inside area 
of a virtual object, if the digital camera 300 receives a 
notice telling that object information does not exist, from 
the virtual-object management apparatus 100, capturing 
prohibition may be released. 

[0120] 

In the above embodiment, virtual objects are set in a 
fixed manner. Setting of a virtual object is not limited to 
this case. A virtual object may be set in a movable manner. 
A virtual object can be set so as to appear or disappear 
according to a time condition. For example, a virtual 
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object appears at a predetermined place at a predetermined 
time, makes a predetermined movement, and when a 
predetermined period elapses from that point of time, the 
virtual object disappears. Therefore, a change in condition 
in terms of place and time can be handled in a relatively 
flexible manner. 
[0121] 

In the above embodiment, object information and service 
information are transmitted and received by radio. A 
transfer method is not limited to this case. The 
information may be transferred through a network. 
Alternatively, the information is stored in a storage 
medium, such as an IC-card chip or a two-dimensional bar 
code, and transferred through it. 

In the above embodiment, the digital camera 300 stores 
in advance a program (corresponding to processing shown in 
Fig. 14) for interpreting object information and service 
information. Interpretation of the information is not 
limited to this case. The object information and the 
service information may be interpreted in a way in which the 
digital camera 3 00 does not have such a program, the 
virtual-object management apparatus 100 includes the program 
in the object information and sends them, the digital camera 
300 only gives location information to the received program, 
and the program is executed to interpret the object 
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information and the service information. 
[0122] 

Therefore, a new service can be received just by- 
modifying the program of the virtual-object management 
apparatus 100 without changing the internal setting of the 
digital camera 300. 

In the above embodiment, object information and service 
information are stored in the virtual-object management 
apparatus 100. Storage of the information is not limited to 
this case. The object information and the service 
information may be stored in different apparatuses with the 
virtual-object management apparatus 100 storing only access 
information (such as short cuts) for accessing the 
information. In this case, the digital camera 300 obtains 
the access information from the virtual-object management 
apparatus 100, and obtains the object information and the 
service information according to the access information. 

[0123] 

In the above embodiment, service is provided by actions 
of capturing prohibition and an indication of a description. 
The service is not limited to this case. Notice information 
related to a notice, or guidance information related to a 
guidance may be provided. 

In the above embodiment, the digital camera 300 and the 
virtual-object-setting apparatus 200 cooperate to provide 
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the service. The structure is not limited to this case. 
With the use of a projector, a printer, a personal computer, 
an audio unit, a scanner, a PDA, a portable telephone, a 
watch- type PDA, or a point-of-sale (POS) terminal instead of 
the digital camera 3 00, the used unit and the virtual - 
object-setting apparatus 200 may cooperate to provide the 
service . 

[0124] 

When a projector is used, a virtual object is formed, 
for example, at the projector or near the projector. When 
it is determined that a mobile member, such as a card or a 
portable telephone, is disposed in the inside area of the 
virtual object, projection service is provided by the 
projector. When a printer, a personal computer, a scanner, 
an audio unit, or a POS terminal is used, service unique to 
the used unit can be provided in the same manner as for the 
projector. 

[0125] 

When a PDA is used, when it is determined that the PDA 
is disposed in the inside area of a virtual object formed at 
a place, predetermined service is provided in the same 
manner as for the digital camera 300 used in the above 
embodiment. When a portable telephone or a watch- type PDA 
is used, predetermined service can be provided in the same 
manner as for the PDA. 
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In the above embodiment, control programs stored in 
advance in the ROMs 32, 52, and 72 are executed to perform 
the processing shown in the flowcharts of Fig. 5 to Fig. 8, 
Fig. 10 to Fig. 12, and Fig. 14. Execution of the 
processing is not limited to this case. Programs showing 
the procedures, stored in storage media may be read into the 
RAM 34, 54, and 74 for execution. 

[0126] 

The storage media include any recording media, such as 
semiconductor media, including a RAM and a ROM; magnetic 
storage media, including a floppy disk and a hard disk; 
optical -reading storage media, such as a CD, a CDV, an LD, 
and a DVD; and magnetic-storage/optical-reading storage 
media, including an MO, which can be read by computers 
irrespective of reading methods, such as an electronic 
method, a magnetic method, and an optical method. 

In the above embodiment, a service providing system, a 
management terminal, a mobile member, and a service 
providing program according to the present invention are 
applied to a case in which, as shown in Fig. 1 and Fig. 2, 
the virtual-object-setting apparatus 2 00 disposes and sets 
the cubic virtual objects A and B in front of the pictures A 
and B exhibited on a wall surface in the art museum, and 
capturing by the use of the digital camera 3 00 is prohibited 
in the inside areas of the virtual objects A and B. 
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Application of the present invention is not limited to this 
case. The present invention can also be applied to other 
cases within the scope and spirit of the present invention. 
[Brief Description of the Drawings] 
[Fig. 1] 

Fig. 1 is a view showing the structure of a network 
system to which the present invention is applied. 
[Fig. 2] 

Fig. 2 is a view showing the structure of the network 
system to which the present invention is applied. 
[Fig. 3] 

Fig. 3 is a block diagram showing the structure of a 
virtual-object management apparatus 100. 
[Fig. 4] 

Fig. 4 is a view showing a data structure in a virtual- 
object management table 400. 
[Fig. 5] 

Fig. 5 is a flowchart of virtual-object generating 
processing. 
[Fig. 6] 

Fig. 6 is a flowchart of virtual-object deleting 
processing. 
[Fig. 7] 

Fig. 7 is a flowchart of virtual-object updating 
processing. 
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[Fig. 8] 

Fig. 8 is a flowchart of object- information 
transmitting processing. 
[Fig. 9] 

Fig. 9 is a block diagram showing the structure of a 
virtual-object-setting apparatus 200. 
[Fig. 10] 

Fig. 10 is a flowchart of virtual-object-generation 
request processing. 
[Fig. 11] 

Fig. 11 is a flowchart of virtual-object-deletion 
request processing. 
[Fig. 12] 

Fig. 12 is a flowchart of virtual-object-update request 
processing. 
[Fig. 13] 

Fig. 13 is a block diagram showing the structure of a 
digital camera 300. 
[Fig. 14] 

Fig. 14 is a flowchart of object-information- 
transmission request processing. 

[Reference Numerals] 
100: Virtual-object management apparatus 
200: Virtual-object-setting apparatus 
300: Digital camera 
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30, 50, 70 

32, 52, 72 

34, 54, 74 

38, 58, 78 

40, 60, 80 



CPU 
ROM 
RAM 
I/F 



Radio communication apparatuses 
42: Virtual-object management DB 

66, 86: Location-information acquisition apparatus 
62, 82: Key panel 
64, 84: LCD 

88: Capturing apparatus 
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[Name of Document] ABSTRACT 
[Abstract] 

[Object] To provide a service providing system which 
allows the user to easily receive service, which allows the 
user to receive not only information providing service but a 
variety of service, and which can flexibly handle a change 
in condition. 

[Solving Means] A virtual-object management apparatus 100 
associates object information related to the shape and the 
location of a virtual object with service information and 
stores them, and sends the object information and the 
service information stored in a virtual-object management DB 
42 to a digital camera 300 in response to a transmission 
request sent from the digital camera 300. When the digital 
camera 300 determines from the obtained location information 
and the received object information that the digital camera 
300 is disposed in the inside area of the virtual object 
identified by the shape and location of the virtual object, 
it executes an action corresponding to the virtual object, 
according to the received service information. 
[Selected Figure] Fig. 2 
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[Name of Document] DRAWINGS 
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